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Abstract. We compute the generalized triangle inequalities explicitly for 
all rank 3 symmetric spaces of noncompact type. For SL(4, C) there are 
50 inequalities none of them redundant by IKTWI . For both Sp(6,C) and 
Spin(7, C) there are 135 inequalities of which 24 are trivially redundant in 
the sense that they follow from the inequalities defining the Weyl chamber A. 
There are 9 more redundant inequalities for each of these two groups. One 
interesting feature is that these inequalities do not occur for the other system 
(and consequently must be redundant because the two polyhedral cones are 
the same by Theorem ll.8l . The two equal polyhedral cones D3(-B3) = Dz{Cz) 
have precisely 102 facets and 51 generators (edges). 



1. Introduction 

Let G be a connected semisimple real Lie group with no compact factors and 
finite center and Lie algebra K he a. maximal compact subgroup and X — G / K 
be the associated symmetric space. By a symmetric space of noncompact type we 
will mean a symmetric space G/K where G is as above. We let t denote the Lie 
algebra of K and let g = ? p be the Cartan decomposition. Let a be a Cartan 
subspace in p (i.e., a maximal subalgebra in p which is necessarily abelian). Let A 
be the real points of the split torus in G corresponding to a. Choose an ordering 
of the restricted roots and let A C a be the corresponding (closed) Weyl chamber. 
Let be the image of A under the exponential map exp : g — > G. Let o be the 
point in X that is fixed by K. We will refer to o as the basepoint for X . We will 
need the following theorem, the Cartan decomposition for the group G, see |Hej . 
Theorem 1.1, pg. 402. 

Theorem 1.1. We have 

G = KAi^K. 

Moreover, for any g £ G, the intersection of the double coset KgK with consists 
of a single point to be denoted a{g). 
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Suppose X1X2 is the oriented geodesic segment in X joining the point xi to the 
point X2. Then there exists a unique element g ^ G which sends xi to o and X2 to 
y = exp((5) where (5 e A. Note that the point 6 is uniquely determined by xiX2- 
We define a map a from G-orbits of oriented geodesic segments to A by 

a{xiX2) = S. 

Clearly we have the following consequence of the Cartan decomposition. 

Lemma 1.2. The map a gives rise to a one-to-one correspondence between G- 
orbits of oriented geodesic segments in X and the points of A. 

Remark 1.3. In the real-rank 1 case a{xiX2) is just the length of the geodesic 
segment xiX2- In general we will call a{xiX2) the A-length of X1X2 or the A- 
distance between xi and X2- We will write di\{xi,X2) = (j{xiX2). 

We note the formula 

dA{xi,X2) = \oga(g^^g2) where xi = giK,X2 = 52^^^- 

Remark 1.4. The delta distance is symmetric in the sense that 

dA{xi,X2) = ~'WQdA{x2,Xi), 

where wq is the longest element in the restricted Weyl group. However, the naive 
triangle inequality 

dA{xi,X3) < dA{xi,X2) +dAix2,X3) 

does not hold KL M2| . Here the order is the one defined by the cone A. The naive 
triangle inequality has to be replaced by the inequalities below. 

We have the fundamental problem of finding the generalized triangle inequalities 
for X, precisely we have 

Problem 1.5. Give conditions on a triple (wi,t'2j^3) G A"^ that are necessary 
and sufficient in order that there exist a triangle in X with vertices xi,X2,X3 such 
that dAixi,X2) = vi , dA{x2,X3) = V2 and dA{x3,xi) = V3. 

We now describe a system of linear inequalities on A'^ which will give the 
required necessary and sufficient conditions. These inequalities will be called the 
generalized triangle inequalities. 

Remark 1.6. We will include the inequalities defining in in the gener- 
alized triangle inequalities. 

We will need the following: 

Definition 1.7. Suppose that W and W' are Coxeter groups acting on V and 
V' respectively by their natural reflection representations. We define a monomor- 
phism of Coxeter systems to be a pair (/, (p) where f : V ^ V' is an isometric 
embedding and 4> is a monomorphism W — s- W' satisfying f{wx) = 4>{w)f{x). 

First we reduce to the case in which G is complex by the following: 

Theorem 1.8 ([TM, KLMl ). 1. The set DsiX) c A^ of triples {vi,V2,v3) 
for which a triangle in the Problem 1.5 (for X) exists, is a polyhedral cone. 

2. 1)3 (X) depends only on the spherical Coxeter complex associated to X. 
More precisely, a monomorphism (/, (j)) of the Coxeter system (a, W) to the Coxeter 
system {a' ,W') induces an affine embedding D3{X) D3{X'). In particular, if f 
and 4> are also surjective, then the map D^i^X) D3{X') is an affine isomorphism. 
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Thus given G as above we can replace G by any complex semisimple group of 
the same rank as G whose Weyl group coincides with the restricted Weyl group W 
of G. Thus it suffices to find the generahzed triangle inequalities for the case in 
which G is complex. 

So from now on we will assume that G is a connected complex semisimple 
group. We will accordingly often rewrite D'i{X) as D'i{R) where R is the reduced 
root system associated to the restricted root system of X. 

The system of inequalities for D'i{R) breaks up into rank(g) subsystems *p 
where P is a standard maximal parabolic subgroup. The subsystem *p is controlled 
by the Schubert calculus in the generalized Grassmannian G/P m. the sense that 
there is one inequality *uji,uj2,uj3 for each triple of elements wi, W2, w^a G such 
that 

in H^,{G/P). Here is the set of minimal length coset representatives for the set 
of cosets W/Wp {Wp being the Weyl group of P), • is the intersection product and 
X^,w G W^, is the Schubert class in G/P. To describe the inequality *wi,w2,w3, 
let P be the standard maximal parabolic corresponding to a fundamental weight A. 
Then the action of W on the weight lattice of g induces a one-to-one correspondence 
/ : — > WX. Thus we may reparametrize the Schubert classes in G/P by 
elements of a*. We let Xi = f{wi),i — 1,2,3. We will sometimes denote the 
Schubert cycle X:^ as ^/(u,)- Then the inequality *wi.w2.w3 is given by 

Al(wi) -t- A2(W2) + A3(W3) < 0, {V1,V2,V3) £ A^. 

Remark 1.9. The key point is that there is a basis of the algebra H^{G/P) 
parametrized by certain linear functionals on a. 

In order to give an accurate account of the history of work on the problem, 
we first need to describe the corresponding problem for the infinitesimal symmetric 
space p. The AdK orbits in p are again parametrized by the points of the cone A. 
Thus given a triple of side-lengths (wi, W2, 1's) G A^ as above we can look for a triple 
e = (ei, 62, 63) e p^ such that ei G AdK • ui, 62 G AdK ■ V2, 63 G AdK ■ V3 and 

ei + 62 + 63 = 0. 

We let -D3(p) be the subset of (wi, 112, ^3) G A^ such that there is a solution to the 
above problem. The following theorem (for all connected semisimple groups with 
no compact factors) was proved in |KLM1| (however see below). 

Theorem 1.10. D3(p) = DsiX). 

Many people contributed to finding the generalized triangle inequalities. The 
reader is urged to consult jFu| and KLM2 for a more complete account. In 
fact the inequalities were computed for the infinitesimal symmetric space p for G 
complex by |BeSj| and jLM| and for general G (real or complex) in |LM| . An 
intense interest in recent years in the generalized triangle inequalities was triggered 
by the paper of Klyachko, |KIy98| . Klyachko proved the generalized triangle in- 
equalities for GL{m, C) in the infinitesimal symmetric space case and a refinement 
was obtained by Belkale |Bel) . In a second paper, Klyachko, |Kly99| , proved the 
equality I?3(p) = D^^X) for certain symmetric spaces of complex simple groups 
(including SL{m)). In |AMW| . Alekseev, Meinrenken and Woodward proved the 
corresponding equality for all complex simple G. 
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The above system of inequalities is not so explicit; in particular, the polyhe- 
dral cone Z?3(i?) is not well understood. Thus it is important to compute explicit 
examples. We will see that the theorem of Knutson,Tao and Woodward |KTW| 
that the inequalities are irredundant for GL{m) is highly exceptional. 

Definition 1.11. The inequality *wi,w2,w3 will be said to be trivially redundant 
if it is a consequence of the inequalities defining the cone A in a. 

In the case G has rank one, the generalized triangle inequalities are precisely 
the ordinary triangle inequalities. The rank two examples were worked out in 
[EM) . For the cases of B2 = C2 and G2 the above system of inequalities was not 
minimal. For the case of B2 there was one trivially redundant inequality. Once it 
was removed the remaining inequalities were irredundant. For the case of G2 there 
were no trivially redundant inequalities but three redundant inequalities. The point 
of this paper is to work out all the rank three examples. We will see that for C3 and 
there are 24 trivially redundant inequalities. It is rather surprising that there are 
only 9 more redundant inequalities. Furthermore as explained in the abstract these 
redundancies were easy to find since the redundant inequalities occurred for one 
system and not for the other. Thus we might say that only "obvious" redundancies 
occurred. Another interesting consequence is that although the polyhedral cones 
D^{B^) and 1)3 (C3) are isomorphic (i.e., there is an affine isomorphism from one 
to the other) by Theorem 1 1.81 the systems of inequalities are different. 

In Chapter 3, see Theorem 13.101 we have given a self-contained account of 
how one uses the Demazure-B.G.G. operators to realize the duals of the Schubert 
homology classes in the Borel model. Our calculations in this paper of the products 
of Schubert classes aare based on this realization. 

This paper is dedicated to Robert Greene on the occasion of his sixtieth birth- 
day. The third author takes great pleasure in acknowledging many helpful conver- 
sations and some hard- fought tennis matches over the years. This paper depends 
on ILMj and the two papers jKLMl| and |KLM2| . We have used the computer 
program Porta written by Thomas Christof and Andreas Lobel. Finally we would 
like to thank George Stantchev for finding the computer program Porta and for 
much help and advice in implementing it. 

2. Schubert cycles in generalized flag varieties 

We continue to assume that G is a connected complex semisimple algebraic 
group. For convenience, we further assume that G is simply-connected. We fix a 
Borel subgroup B oi G. Let b, resp. g, be the Lie algebra of B, resp. G. We 
also fix a Cartan subalgebra f) C b. The choice of ((), b) determines the set 11 C f}* 
of positive roots and thus the set $ — {ai, • • • , a;} C 11 of simple roots and also 
the fundamental weights {wi,--- ,0;/}, I being the rank of G. We consider the 
real form a of f) which is the real span of the simple coroots {«! , • ■ • , Q!;^}. Then 
n C a* and also LOi E a*. Any algebraic subroup P oi G containing B is called a 
standard parabolic subgroup. Let A C a* be the cone on the fundamental weights. 
By definition, the dominant weights are the elements of Z+w^. 

To each dominant weight A we define the associated standard parabolic subgroup 
Px to be the (connected) subgroup of G with Lie algebra spanned by b together 
with the root vectors X-a (corresponding to the root —a) such that X{Ha) = 0. 
Here a runs through the positive roots 11 of g and Ha G a is the corresponding 
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coroot which is equal to under the KiUing form. We let S be the set of (simple) 
reflections in the root hyperplanes defined by the simple roots and let W C Aut t) 
be the Weyl group generated by S. Then W can canonically be identified with the 
group N{T)/T, where T is the maximal torus of G with Lie algebra f) and N{T) is 
its normalizcr in G. 

For any standard parabolic subgroup P of G, let Wp C be the subgroup 
consisting of those w that have representatives in P and Sp = SCi Wp . We let £ be 
the length function on W. Each coset wWp in W/Wp has a unique representative 
of minimum length |Hi82| . Ch. I, Corollary 5.4. We will denote this element by 
w* = Wp. The set of such representatives will be denoted by . We have the 
following criterion for the minimum length element in the coset wWp, see |Hi82j . 
Ch. I, Corollary 5.4. 

Lemma 2.1. w* G wWp is the minimum length representative if and only if 

i{w*s) = l{w*) + 1, for all s £ Sp. 

We will also need the following result, see jHi82| . Ch. I, Theorem 5.3. 

Lemma 2.2. Suppose that w £ and v e Wp. Then 

e{wv) ^£{w)+£{v). 

We now recall the Bruhat decomposition for G, see jHej . Theorem 1.4, pg. 403. 

Theorem 2.3. For any standard parabolic subgroup P of G, 

(1) G = U^ew BwB , 

(2) G = U^e^P BwP 

As a consequence of (2) the generalized flag variety G/P is the disjoint union of 
the subsets {C^ := BwP/ P}^^^y^^r . The subset is biregular isomorphic to the 
affine space C^'-"'-' and is called a Schubert cell. The closure of G^, to be denoted 
X^, is an algebraic subvariety of G/P and is called a Schubert variety. We will use 
[X^] to denote the integral homology class in H^{G/P) carried by but we will 
often abuse notation and use the same symbol for the variety and its class in 
homology. We will use PD{X!^) to denote the cohomology class (of complementary 
degree to the degree of X!^) associated to by the Poincare duality. In what 
follows we will let = dim{G/B) = l{wo) and Np = dim{G/P). 

We recall the following well known: 

Theorem 2.4. The integral homology H^(G/P) is a free Z-module with basis 
{XP:w& W^}. 

In particular, the integral homology H,,{G/B) is a free Z-module with basis 
{AT^ : w G W}, where X^ is abbreviated by AT^. 

Since H^{G/P) is free and we have a distinguished basis (the Schubert classes) 
it is reasonable to consider the basis for the corresponding cohomology groups that 
are dual under the Kronecker pairing ( , ) between homology and cohomology. Let 
{e^ : w S W^} denote the dual basis. Thus we have for w, w' G W^ , 

It suffices to study H*{G/B) because of the following well known theorem. 
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Theorem 2.5. Let ttp : G/B G/P be the projection. Then the induced 
map TTp : H*{G/P) H*{G/B) is injective with image precisely equal to the 
Wp-invariants of H*{G/B). 

Moreover, for w G , 

* / P\ _ 

'^PK^w) — ^if: 

where again we abbreviate by e^. 

So, from now on, we will identify H*{G/P) as a subring of H*{G/B) and 
denote by itself. 

2.1. Poincare duality in G/P. In the following, for each w e we will 
need to identify PD{X^) in terms of the basis {e^}a,^wp- 

Define the involutive map 9^ :W hy 9^{w) = wqwwq^p, where wq (resp. 

Wo,p) is the longest element of W (resp. Wp). 

For lack of a precise reference, we give a proof of the following: 

Proposition 2.6. For w e , 6^{w) e and we have 

The proposition will follow from the next two lemmas. 

Lemma 2.7. The map 9^ carries into itself. Moreover, we have 

e{9^{w)) = Np~e{w), 

where Np denotes the complex dimension of G/P. Thus, Np = i{wo) — i(wo^p). 

Proof. For w G and any v € Wp we have 

£{wowwo^pv) — £{wo) — £{wwo^pv). 
But, by Lemma [2. 21 since w g and wq,pv G Wp we get 

£{wwo,pv) = £{w) + £{wo,pv) = £{w) + £{wo^p) - £{v). 

Thus, 

£{wowwo,pv) = {£{wo) - £(w) ~ £{wo.p)) + £{v). 

But the above argument shows that the terms in parentheses equal £{wowwo^p). 
Thus multiplying 9^{w) by any v G Wp increases the length of 9^{w) and accord- 
ingly by Lemma l2. II we have 

9^{w) G W^. 

Taking v to be the identity in the above formula we have 

£{vuoVuwq^p) = £{wo) - £{wq^p) - £{w) ^ Np ~ £{w). 

□ 

Before proving the proposition we need a general result from algebraic topology. 
Let M be a compact connected oriented manifold of dimension n. For a G Hp{M) 
and b G Hn-p{M) we will let a-6 denote the intersection pairing, Br ,Ch.V, Section 
11. We then have see |Br| . pg. 367, 

{PD{a),b) ^b-a. 

Remark 2.8. In our case all the homology is even dimensional so we will not 
have to worry about the interchange of order. 
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Suppose now that Hi,{M) is free over Z and accordingly we have HP{M) = 
Homz(i?p(M), Z). Thus to prove the proposition we have to identiiy the element 

PD{X.P) of Homz(F2JV,_2£(^)(G/P),Z). 

The key point in the proof of the proposition is then 

Lemma 2.9. For v,w € with £{v) = £{w), 

Proof. Since the action of any clement of G by left-multiplication on G/ P induces 
the trivial action on H*{G/P), to prove the lemma it suffices to prove the following 
equalities at the cycle level: 

(3) ■ «;o<p(,) = 0, if^; 7^ w, 



(4) . wnX^,^^^ = {w}. 

Suppose that the above cycles and w^X^p^^^^ intersect in a nonempty set. Then 
(since each cycle is T-stable) the intersection is T-stablc and projective and conse- 
quently will contain a T-fixcd point, say u £ . Since the Schubert cell BwP/P 
contains the unique T-fixed point w and BwP/ P = |J BxP/P we find u < w. 

Similarly, since u G wqBwqvwq pP/ P and wq is of order 2, we have wquWo^p € 
BwqvP/P and as above we find wquwo^p < wovwo^p and hence uwo^p > vwo^p. 
But since u,v € W^, we get u> v (cf. [Ku], Lemma 1.3.18). 

Thus V < u < w. But since £(v) = £{w), we obtain v = u = w. By the above 
argument the intersection X^ CiwoXgp^^s^ = {w} set theoretically. The proof of (4) 
is completed by observing that the intersection is tranverse at w or alternatively 
by using the Poincare duality and (3). □ 

Thus as operators on H2Np-21{w){G / P) we have PD{XP) = esp^w) and the 
proposition follows. 

3. A formula for 

3.1. The Borel modeL We continue to assume that G is a connected, simply- 
connected complex semisimple algebraic group. As earlier let denote the i-th 
fundamental weight. Recall that the Borel model for H*(G/B) is obtained through 
the Borel homomorphism 

/?:Z[a;i,a;2,-- - ^ H*{G/ B), 
which is the unique algebra homomorphism taking uji to the first Chern class of the 
line bundle on G/B associated to the character —Ui of B. It is easy to see that the 
homomorphism /3 commutes with the Weyl group actions and thus for any standard 
parabohc subgroup P of G, the Wp-invariants Z[a;i,a;2,-"' I'^z]^^ is mapped to 
H*{G/P) under /3. 

Let I C Z[a;i,a;2, • • • , w;] be the ideal generated by the M^-invariant polyno- 
mials with zero constant term. Then by extending the scalars to the real numbers 
M, /3 induces a surjective homomorphism (still denoted by) /? : M[a;i,tc'2, • • • , w;] — > 
H*{G/B,M.), with kernel precisely equal to := I 
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In a subsequent subsection we will use the divided-difference operators of De- 
mazure and Bernstein-Gelfand-Gelfand to find a polynomial pw G M[a;i,-- - ,lui] 
such that (3{pw) is the cohomology class for w e W . 

3.2. The Demazure— BGG operators. For more details on this subsection 
the reader is urged to consult (Hi82) . Chapter IV and |Ku| . Chapter XI. We will set 
V = a* henceforth. Let ai be a simple root and let Si be the corresponding simple 
reflection. We define the divided difference operator As^ : S'^{V) — ^ S^~'^{V) by 



a. 



We note that As^ o Ag. =0. It is also important to note (and simple to prove) 
that As^ is a twisted derivation in the following sense. 

Lemma 3.1. As^{pq) = AsXp)q + {sip)As^{q). 

From the definition and the above lemma, it is easy to see that A^. keeps the 
integral form 1^2, •' ' ,^1] C S{V) stable and, moreover, it also keeps /k stable. 
For any w £W we further define Ayj by 

Aw ■■= As^oAs^o---o Ag^ 

where w — si ■ ■ ■ Sk is a reduced decomposition of w as a product of simple reflec- 
tions. We have |Hi82| . Chapter IV, Proposition 1.7, 

Proposition 3.2. The operators A^ are well-defined, i.e., they do not depend 
upon the choice of the reduced decomposition of w. Moreover, we have Aw o Ay — 
Awv if i{wv) = £(w) + £{v) and Aw o ^„ = otherwise. 

3.3. The topological Demazure BGG operators. As earlier, for any topo- 
logical space X, H*{X) denotes the singular cohomology of X with integral coeffi- 
cients. 

There is an analogue of the Demazure-BGG operator Dg^ on H*{G/B) (for 
any simple root ai) defined directly as follows. 

Let TTi : G/B — >• G/Pi be the locally trivial fibration with fibre (over ePi) 
Pi IB ~ Pi. It is easy to see that the restriction map 7 : H*{G/B) H*{P,/B) 
is surjective. In fact. Eg. maps to the generator of H^{Pi/B). Choose a Z-module 
sphtting a : H*{P,/B) H*{G/B) of 7. Then by the Leray-Hirsch Theorem, the 
map 

$ : H*{G/Pi) ® H*{P,/B) H*{G/B), u(g)v^ (7r» U cr(w), 

is an isomorphism. Hence, tt* is injective and H*{G/B) is a free module over 
H*{G/Pi) (under tt*) with basis 1 and a{e), where e £3,^^^./^^ £ H'^{Pi/B) is 
the generator, i.e., 

H''{G/B) = H''{G/Pi)®a{e)H''-^{G/Pi), for any n > 0. 

Write, for any u e H*{G/B), 

U = Tl*Ul + a{e) TT*U2, 

where ui G H*{G/Pi) and U2 G H*^^{G/Pi) are uniquely determined by the above 
equation. 

Now define 

Ds,u:^TT*U2 eH*-^{G/B). 
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It is easy to see that Ds- does not depend upon the choice of the spUtting a. 
Clearly, 

Dl = 0. 

Proposition 3.3. The Borel homomorphism (3 intertwines As- and Ds- for 
any simple reflection Si . 

Proof. Let R be the ring Z[ll!i,uj2, • ■ ■ jW;] and Ri the subring of s^-invariants. 
Then R is generated as an i?i-module by 1 and uii. Further, /3{Ri) C H*{G/Pi) 
(of. subsection 3.1). By definition, A^- commutes with the multiplication by Ri 
and also Ds^ commutes with the multiplication by H*{G/Pi). Moreover, Ds^il) ~ 
As-{1) = 0. Thus, to prove the proposition, it suffices to observe that 

(*) DsM^^))=|3{AsA^^)) = ^■ 

Now, it is easy to see that [3{L0i)\(^p./B) is the generator e, which proves (*). □ 
Thus the operators Dg^ again satisfy the braid relations and we may extend 
Dsi to Dyj by taking a reduced decomposition of w. Moreover, Ds^ satisfies the 
twisted derivation property: 

DsAxy) = DsMy + {s,x)DsM, fora;,y e H*{G/B). 

We also recall the following well-known result due to Chevalley, cf. [BGG], 
Theorem 3.14. 

Lemma 3.4. For any simple reflection Si and any w G W , the cup product 
(5) • e„ = ^ (wwi,/3^} e^, 

/3 

W — >V 

where the notation w-^v means w < v, £{v) — £{w) + 1, /? G 11 and v = s^w; and 
sp^W is defined by spx = X - {x,P'^)P, for X^V- 

The following result is of basic importance. 

Proposition 3.5. For any simple reflection s,; and any w S W , 

Dsi^w = if WSi < w, 

and 

Dsi^w = 0, otherwise. 

Proof. We first consider the case wsi > w so w ^ W^'. By Theorem 12.51 G 
H*{G/P^), hence L»,..e^. = 0. 

So assume now that wSi < w. By the Chevalley formula 13.41 

esi ■ ^ws, = £«, + ^ {wSiUJi, 0^)ey. 

wsi — yv,v^w 

By a standard property of Coxeter groups [Ku], Corollary 1.3.19, any v appearing 
in the above sum satisfies vsi > v. Hence applying Z?s. to the above equation and 
using the previous case, we get 

DsA'^si ■ e-wsi) = DsX^-w)- 
By using the twisted derivation property and the previous case again, we get 

^Sii^^Si ' ^wsi^ — T) Siij^Si)^wSi — ^wsi: 
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since Ds^icsi) — 1 (because restricted to Pi/B equals e). Combining the above 
two equations, we get the proposition. □ 

3.4. The polynomials p^,. In this section we will polynomials such that 

First we will find p^^ . We define p^o for wq the longest element in W as follows. 
Let d be the product of the positive roots. Then define 



(6) Pwo = 

Proposition 3.6. 

PiPwo ) — ^Wq ■ 

As we will see that Proposition 13.61 will be an almost immediate consequence 
of Lemma 13.81 However we need a preliminary general lemma from algebra. 

Let G be a finite group and p : G — > Aut(V') be a faithful representation. Let 
TZ = S{V*) be the algebra of regular functions on V and J- = Q{y*) be the quotient 
field. The representation p induces a representation p from G into Aut(J-') where 
we consider as a vector space over the fixed field C :— T'^ . We have 

Lemma 3.7. The set {p{g) '■ g G G} is an independent subset of the T vector 
space Endc{y^), where T acts on Endc{J^) via its multiplication on the range. 



Proof. Suppose we have a minimal dependence relation 

laPig) = 0, e J^. 

aeG 

Write Qg = with ag,bg e TZ and relatively prime. For / G 7^ we let V{f) 
denote the zero locus of /. For each g E G, let F{g) be the fixed subspace of 
p{g). For g ^ I the subspace F{g) is proper hence {_]g^iF{g) C V. Choose 

^0 e V\{{}g^jF{g)\jyjg^^V{ag)yj{}g^ayib9))- ThenG^G-«o is an embedding. 
Fix go G G. Find a polynomial pg^ such that 

(1) p<,„(p(5o)-H«o))-l 

(2) PgM=^,v^G-v^\{p{go)-\v^)}. 

Now = Y.geG^aMp{9)Pgo{'"o) = Eggc ^^(^^oKo (p(g)"^wo) = QgoM + 0. This 
is a contradiction. □ 

Lemma 3.8. A^^p^a = 1- 

Proof. Take a reduced decomposition wq = Si-^ ■ ■ ■ Si„ . Then it is standard that 

} is an enumeration of the positive roots. For q e 
let Mq be the operation of multiplication by q. Write A^^ — M^-i{I — s^^) o 

• ■ • o {I — Si„). It is then easy to see that for any p ^ TZ we may write (see 

the next paragraph) 

(7) A^„p^ ^ qwW-p. 
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Moreover we have 

(8) q^o = i-lf^ 

Let Si be a simple reflection. Since £{siWQ) < £{wq) we have, by Proposition 
13.21 Ag.AujgP — 0. From this we see that for all p G 7^ we have J^QwW ■ p = 

w 

' 9to)(siW ■ p)- Apply Lemma 71 to conclude 

w 

(9) Si ' QsiW — Qw ■ 

Combining this with JSJ we obtain 
Hence by (|7|l we obtain 

□ 

Now we can complete the proof of Proposition 13.61 From dimiG/ B) — N we 
deduce that the A^-th graded component of S'(F*)//r is a one-dimensional vector 
space over R with basis {swo}- We will now prove that d (or Pwo) is another basis 
element. 

We prove that d ^ /r. Suppose d £ /r. Then d ^ J^t fi9i where g.^ £ S{V*)^ 
are homogeneous with zero constant term. By applying the alternator '^{—lY^'^^w 

w 

to both sides we see that we may assume that the fi are antiinvariant elements 
of S{V*). But any antiinvariant element vanishes on all the root hyperplanes and 
consequently is divisible by d. We conclude that all the fi's are zero. This implies 
that d = 0, a contradiction. 

Since d has degree N we find that d (and hence p^g) is another basis vector 
for the iV-graded component of S{V*)/I^. Hence there exists c G R such that 
(mod /r). But, by Proposition we have A^gCwo = — 1- Hence 
c = ^u)oPt«o- Thus, by Lemma 13.81 we have c—1 and Proposition 13 . 61 is proved. 

We obtain as a first consequence the following 

Lemma 3.9. The Weyl group W acts on the top graded component (of degree 
£{wo)) of the graded ring S{V)/Ik. by the sign representation. 

We next define Pw for a general w. Express w as a left segment of wq. Precisely 
we find V such that wq — wv and Hwq) = £{w) + £{v). Then we define 

As a consequence of Propositions 1X^13. 61 and l3. 51 we get the desired realization 
of the duals of the Schubert homology classes in the Borel model. 

Theorem 3.10. 

P{Pw) = <^w 

We will need the following lemma. 
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Lemma 3.11. Suppose that we have a factorization w = wivi with £{w) = 
i{wi)+£{vi). Then 

-^viPw Pwi ■ 

Proof. Suppose we have realized w as a left segment of wq by wq = wv. Then wq — 
wi{viv) realizes wi as a left segraent of wo with Wi^wq = viv and j\.y^y — -^vi ^ -^v 
by Proposition 13. 21 □ 

4. The inequalities for the rank 3 root systems 

In this section we describe the inequalities for the rank 3 root systems A3, C3 
and ^3. Since there are many inequalities in each case we will give only a system 
of representatives modulo the action of the symmetric group S3 and leave to the 
reader the task of symmetrizing the inequalities. We note that the polytopes for C3 
and B3 are isomorphic by Theorem ll.81 though we will see below that the systems 
are different. We will also see that there are many trivially redundant inequalities 
labelled as (*). 

In each of the three cases there are 3 standard maximal parabolics, hence the 
system breaks up into three subsystems. We let r,s and t be the simple reflections 
associated to the nodes from left to right of the Dynkin diagram following the 
Bourbaki convention (so t corresponds to the long simple root in the case of C3 
and the short simple root in the case of B3). In what follows wq will denote the 
longest element in W and Wq will denote the longest element in . Let A be a 
fundamental weight. We will also use the notation X^x for the Schubert cycle 
with w € and P the standard maximal parabolic subgroup associated to A. 

In general the Weyl chamber A is a simplicial cone, hence in rank 3 it is 
defined by 3 linear inequalities. These inequalities will contribute 9 inequalities in 
{vi,V2,V3) after symmetrization. 

4.1. The inequaUties for A3. In this case the quotients G/P for maximal 
parabolics P are Grassmannians and the cohomology rings are well-known. In par- 
ticular, all the structure constants are 1 or 0. We will merely record the inequalities 
for the three subsystems. The Weyl chamber A is given by 

A — {(a;, y, z,w) :x + y + z + w = 0,x>y>z> w}. 

We give below the inequalities in terms of triples ivi,V2,V3) G A'^ with Vi — 
{xi,yi, Zi,Wi),i = 1,2,3. But, to get the full set of inequalities, we need to sym- 
metrize these with respect to the action of S'3 diagonally permuting the variables 

Xl,X2,X3; 2/1, 1/2, Zi,Z2, Z3; Wi,W2,W3. 

4.1.1. The subsystem associated to H* [G / Pi) . In this case the quotient G/ Pi 
is CP'^. Thus, we obtain the subsystem (before symmetrization): 

Xi + W2 + W3 <Q 

yi + Z2+W3 <0 

Zl+ Z2+ Z3 < 0. 

Hence there are 10 inequalities after symmetrization. 
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4.1.2. The subsystem associated to H*{G/P2). In this case the quotient G/P2 
is the Grassmannian of 2- planes in C^. We obtain the subsystem (before sym- 
metrization) : 

xi + yi + Z2 + t«2 + 23 + W3 < 
a;i + zi + 2/2 + W2 + 23 + t«3 < 

Xi + Wi + X2 + W2 + Z'i + W'i < Q 
2/1 + -21 + 2/2 + Z2 + Z3 + ^"3 < 

Xi + wi + 2/2 + ■i«2 + 2/3 + < 
2/1 + + 2/2 + 'i«2 + 2/3 + wz < 

Hence, there are 21 inequalities after symmetrization. 

4.1.3. The subsystem associated to H*{G/P3). This subsystem is dual to the 
first subsystem. In this case the quotient is the Grassmannian of 3-planes in C^. 
We obtain the subsystem (dual to the first) 

a;i + 2/1 + ^^1 + 2/2 + Z2 + W2 + 2/3 + ^^3 + W3 < 
a^i + 2/1 + wi + a;2 + Z2 + W2 + 2/3 + 23 + W3 < 

Xi + Zi + Wi + X2 + Z2 + W2 + X3 + Z:i + W3 < 

Hence again there are 10 inequalities after symmetrization. 

Thus there are altogether 50 = 41 + 9 inequalities defining £'3(713) and the 
system is minimal, |KTW| . where 9 m 41 + 9 accounts for 9 inequalities defining 
in 0^. 

4.2. The inequalities for C3. In this subsection we take simply-connected 
G of type C3, i.e., G = Sp (6). 

We note that the Weyl chamber A is given by the triples x, y, z of real numbers 
satisfying 

X > y > z > 0. 

Here x, y, z are the coordinates relative to the standard basis ei, £2, £3 in the notation 
of |Boj . pg. 254 - 255. The inequalities will now be in terms of {vi, V2, V3) G A^ with 
Vi = (xi, yi, Zi), i = 1,2, 3. We will need to symmetrize the inequalities with respect 
to the action of S3 diagonally permuting the variables a^i, 2:2, X3; 2/1, 2/2, 2/3; ^i, ^2, 2:3. 

In what follows one will often need to verify that an expression of an element 
w W in the generators r, s, t is of minimal length. One can do this by finding the 
word as a connected subword of a minimal length expression of the longest word 
wq- Thus one needs a plentiful supply of such expressions. The first part of the 
following lemma follows from Bo , Proposition 1.2, pg. 121. Also, in the reflection 
representation, the coordinate sign changes are given by rstsr (first coordinate) , sts 
(second coordinate) and t (third coordinate) and wq — —1. From this the second 
part of the following lemma follows easily. 

Lemma 4.1. (1) Let uvw be a product of the simple generators (in any 

order). Then (uvw)^ = Wq. 
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(2) A product of the three sign-changes rstsr, sts,t in any order is equal to 

Wq. 

We will also need the following proposition. 
Proposition 4.2. 

Pwo = x'^y'^ixyz) modi, 

where I is the ideal generated by the W -invariant polynomials in Z[x, y, z] with zero 
constant term. 

Proof. By the definition of (cf. equation ©), we have 

_ „ y2)(^2 _ ^2)(^2 _ P)(2x){2y){2z) 

- 4g 

In the ring Z[X, Y, Z] we have {X-Y){X-Z){Y-Z) = 6X^Y mod J, where J is the 
ideal of Z[X, Y, Z] generated by the symmetric polynomials with zero constant term. 
Now the proposition follows from the above by taking X — ,Y = y^ , Z = z"^ . □ 
We will also need the following simple fact about the Weyl group of C3 . Let 
w G W and choose a reduced decomposition of w. Let n{w, t) be the number of 
times t appears in this decomposition. 

Lemma 4.3. n{w,t) is independent of the reduced decomposition ofw. 

Proof. From the Coxeter group property of W, any one reduced decomposition of 
w ^ W can be obtained from another by using the Artin (i.e. generalized braid) 
relations, that is by replacing rsr by srs or rt by tr or stst by tsts. None of these 
change the number of t's. □ 

4.2.1. The subsystem associated to H*{G/Pi). We have G/Pi ^ CP^ so ah 
structure constants are 1 and we get one inequality for each ordered partition of 5. 
We note that Wp^ is the group generated by s and t. 

We leave the proof of the following lemma to the reader 

Lemma 4.4. W^^ — {e,r, sr,tsr, stsr, rstsr} . 

We will abbreviate the classes for w £ W^^ by a^, i = 1, 2, 3, 4, 5 according 
to the following table. Moreover, in the following table we list the elements w of 
W^^ , their lengths, the maximally singular weight '■= wuJi associated to the 
Schubert cycle — X;^^ and the notation for the cohomology class PD{Xx^), 
the cohomology class that is Poincare dual to X\^ . 



w 


e{w) 


Xw 




PD{XxJ 


e 





(1,0,0) 


1 


05 


r 


1 


(0,1,0) 


ai 


04 


sr 


2 


(0,0,1) 


0.2 


as 


tsr 


3 


(0,0,-1) 


03 


02 


stsr 


4 


(0,-1,0) 


ai 


ai 


rstsr 


5 


(-1,0,0) 


05 


1 



We now give the corresponding subsytem leaving to the reader the task of 
symmetrizing the inequalities below. We label each inequality with the ordered 
partition of 5 that it corresponds to. For example the label (3,2,0) means the 
inequality corresponds to the formula as ■ 02 ■ I — — top class in H*{G/Pi). 
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We then refer to the above chart to obtain PD{a^) — Xf^ = X(o,o,i): ^-^(02) = 
X^s\ = ^(0,0.-1) and PD{1) = X,^\,, = ^(-1,0,0) ■ We have 

-'^(0,04) ■ -'^(0,0,-1) • -^(-1,0,0) = [pi]- 

Applying the hncar functionals (0, 0, 1), (0, 0, —1) and (—1, 0, 0) to wi, f2, 113 respec- 
tively we get the inequality zi — — < 0. 

So the system of inequalities (before symmetrization) is given by: 

xi <X2+x^ (5,0,0) 
yi<y2+x:i (4,1,0) 
zi<Z2+x^ (3,2,0) 



zi<y2 + yi (3,1,1) 
(*) -^i-^2-y3<0 (2,2,1) 

The three inequalities in this subsystem generated by (*) corresponding to the 
ordered partition (2, 2, 1) are trivially redundant and do not occur in the system 
for B3. 

Thus, there are 21 inequalities in this subsystem after symmetrization which 
includes 3 trivially redundant inequalities. There are no other redundant inequalities 
in this suhsytem. 

4.2.2. The subsystem associated to H* {G / P2) ■ The space G/P2 is the space of 
totally-isotropic 2-planes. The group Wp^ is generated by the commuting simple 
reflections r and t. We leave the proof of the following lemma to the reader. 

Lemma 4.5. W^'^ = {e, s, rs, ts, rts, sts, srts, rsts, tsrts, rstrs, rtsrts, srtsrts}. 

We will abbreviate the classes e„ for w G W^^ to Ui or a'^ or a-' as indicated 
in the next table. For the benefit of the reader, we also list for the elements w in 
W^^, the corresponding maximally singular weight w ■ llJ2 — w ■ (1,1,0) and the 
Poincare dual class PD{X^'^). 



w 


Am 


e{w) 


ew 


PD(^A„) 


e 


(1,1,0) 





1 


a? 


s 


(1,0,1) 


1 


ai 




rs 


(0,1,1) 


2 


a'2 




ts 


(1,0,-1) 


2 


a'i 


< 


rts 


(0,1,-1) 


3 






sts 


(1,-1,0) 


3 


4' 




srts 


(0,-1,1) 


4 






rsts 


(-1,1,0) 


4 


a'i 




tsrts 


(0,-1,-1) 


5 


< 




rstrs 


(-1,0,1) 


5 


< 


a'i 


rtsrts 


(-1,0,-1) 


6 




ai 


srtsrts 


(-1,-1,0) 


7 


aj 


1 



We list the polynomials pw (mod /) in the next table, which is obtained by 
applying Lemma f3. Ill and observing that both of x'^y'^ + x'^y'^ and a;'' + + x^y^ 
belong to /. 
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In the following table it will be convenient to use gn to denote the finite geo- 
metric series 



n 
i=0 



w 


V 


w — wv 


Pw{modI) 


srtsrts 


rt 


Wo 


(xy)'-^{x + y) 


rtsrts 


rts 


Wo 


{xyf 


tsrts 


rtsr 


Wo 


xy(x + y){xy + z'^) 


rstrs 


trst 


Wo 


xygs 


srts 


rtsrt 


Wo 


[xyf 


rsts 


rstst 


Wo 


94 


rts 


rts 


rtsrts 


xy{x + y) 


sts 


trstsr 


Wo 


93 


rs 


ts 


rsts 


xy 


ts 


trs 


tstrs 


92 


s 


ts 


sts 


X + y 



Now computing the products of Pw (mod /) and using the Chevalley formula 
Lemma [3.41 we obtain the following. 



Theorem 4.6. The cohomology ring H* {G / P2) is given by the following table. 



H*{G/P2) 




a'2 


4' 


03 




ai 


a'2 + 0,2 




^3 + ag 




a'^ + 2a'i 








04 + a'{ 


< + < 


< 








2a\ + 2al 




< + ^< 












ae 












2aQ 



H*{G/P2) 






a'. 




ae 


ay 


tti 


< + < 


< 


ae 


ae 


ay 





a'2 







aj 











a'i 


ae 


ae 





a? 








a'3 


ay 

















a'i 





ar 















We now write down the subsystem (before symmetrization). 
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xi + yi< X2 + 1/2 + 2:3 + 2/3 (7, 0, 0) 

Xi + Zi < X2 + Z2 + X3 +y3 (6,1,0) 

yi+zi<y2 + Z2+X3+y3 (5',2',0) 

Xl+Z2<Zl+X2+X3 + y3 (5",2",0) 

yi + Z2<zi + y2 + X3 + y3 (4',3',0) 

xi+y2<yi + X2 + x3 + y3 (4",3",0) 

yi + zi < X2 + Z2 + X3 + Z3 (5', 1,1) 

(**) Xi < Zi + X2 + Z2 + X3 + Z3 (5", 1,1) 

(**) yi<Zi+y2+Z2+X3+ Z3 (4', 2', 1) 

yi + Z2<Zi+X2+X3 + Z3 (4',2",1) 

Xl+Z2<yi+X2 + X3 + Z3 (4",2",1,) 

(*) yi + Z2<Xi+y2 + X3 + Z3 (3",3',1) 

(*) zi<yi+y2 + z2 + y3 + z3 (3', 2', 2') 

(*) zi+Z2<yi+x2+y3 + Z3 (3', 2", 2') 

(*) yi+Z2<Xi+X2+y3 + Z3 (3", 2", 2') 



We explain how an inequality corresponds to a decorated ordered partition by 
the example of (4',2",1). The decorated partition corresponds to the three- fold 
product a'^ ■ 03 ■ ai = aj = top class in H* {G / P2) ■ Taking the Poincare dual cycles, 
the above product corresponds to the intersection product Xj^^^ ■ X^^^^^ • ^rtsrts — 
\pt\. Using the correspondence between Weyl group elements in W^^ and linear 
functionals arising from the Wcyl group orbit of (1, 1, 0), wc find that the three Wcyl 
group elements indexing the cycles in the intersection product correspond to the 
linear functionals (0,1,— 1),(— 1,0, 1),(—1, 0,-1). Applying these linear functionals 
to vi,V2,V3 respectively and collecting terms one obtains the inequality yi — z\ — 
X2 + Z2 — X3 — Z3 <0 ov equivalently yi + Z2 < Zi + X2 + X3 + Z3. 

The inequalities in the subsystem labelled (*) corresponding to the ordered 
partitions (3", 3', 1), (3', 2', 2'), (3', 2", 2'), (3", 2", 2') arc trivially redundant. They 
generate (after symmetrization) respectively 6,3,6,6 trivially redundant inequalities. 

The inequalities corresponding to the ordered partitions (5", 1,1), (4',2', 1) 
and (3', 2', 2') do not occur in the system for B3. Consequently they too must be 
redundant. We now check this directly. 

First the three inequalities corresponding to the decorated ordered partition 
(3', 2', 2') arc trivially redundant. In order to check that the three inequalities 
corresponding to (5", 1, 1) are redundant, we observe that we have Xi < X2 -\- X3 
from the first subsystem (corresponding to G/P\). As a consequence we have 
xi < X2 + X3 + zi + Z2 + Z3. Finally to check that the six inequalities corresponding 
to (4',2',1) are redundant, we observe that we have y\ < 2/2 + X3 from the first 
subsystem again. Hence yi <y2 + X3 + zi + Z2 + Z3. 
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This subsystem (corresponding to G/P2) after symmetrization consists of 78 
inequalities of which 21 are trivially redundant (marked by (*))■ There are 9 more 
redundant inequalities marked by (**). These 9 inequalities do not occur in the 
system for B3 . 

4.2.3. The subsystem associated to H*{G/Pz). The space G/P3 is the space of 
totahy-isotropic 3-planes, i.e., the Lagrangian Grassmannian. The group Wp^ is 
generated by the simple reflections r and s. We leave the proof of the following 
lemma to the reader. 

Lemma 4.7. 

W^^ = {e, i, si, rst, tst, trst, strst, tstrst}. 

We again abbreviate the classes to Oj or a- or a" according to the following 
table. 



w 


l{w) 






^^(^aJ 


e 





(1,1,1) 


1 


ae 


t 


1 


(1,1,-1) 


ai 




st 


2 


(l.-l.l) 


02 




r.s7 


3 


(-1.1.1) 






tst 


3 


(1,-1,-1) 




^3 


trst 


4 


(-1,1,-1) 


Oi 


a2 


strst 


5 


(-1,-1,1) 


05 


ai 


tstrst 


6 


(-1,-1,-1) 


ae 


1 



We again give the formulas for (mod /) . In the following tabic we deflne a 
symmetric cubic polynomial f{x, y, z) by f{x, y, z) = x^y + xy^ +x'^z + xz"^ +y'^z + 



w 


V 


w = wv 


^^(mod /) 


Wq^ = tstrst 


rsr 


Wo 


i.xyz)f 


strst 


rstr 




{xyz)(xy + xz + yz) 


lisl 


i-.'il rs 


"u 


[xyz)[x + y + z) 


tst 


rst 


Wq"' = tstrst 


f + xyz 


rst 


rstrst 


Wo 


xyz 


St 


rst 


strst 


xy + xz + yz 


t 


St 


tst 


x + y + z 



Wc now have the following table constructed by multiplying the polynomials 
Pw modulo /. 

Theorem 4.8. The cohomology ring H*{G/ P-i) is given by the following table. 



H*{G/P3) 


ai 


a2 




«3 


04 


as 


ae 


01 


2a2 


2a3 + 03 


04 


2 04 


2a5 


ae 





a2 




2a4 


05 


2a5 


ae 








a'3 









ae 
































Using the above tables, the reader can easily verify that we have the following 
inequalities (which have to be symmetrized). 
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xi+yi + zi <x2 + y2 + z2 + xz + yz + z-^ (6, 0, 0) 

a;i + yi + Z2 < zi + + ?/2 + + 2/3 + ^3 (5, 1, 0) 

2^1 + zi + 2/2 < yi + 2:2 + Z2 + + + Z3 (4, 2, 0) 

x\ + ?/2 + < yi + -zi + a;2 + ^3 + 2/3 + Z3 (3', 3", 0) 

a;i + y2 + Z3 < yi + + 2:2 + Z2 + 2:3 + y3 (3', 2, 1) 



This gives that the subsystem corresponding to G/P3 consists of 27 inequalities. 
None of them are trivially redundant. 

The 27 incquahties above can be rewritten in a very simple way. Let S — 
'}Z'i=i Xi + yi + Zi. Then the 27 inequahties are just the inequahties 

g 

Xt + yj + Zk < —, i, j,k = 1,2,3. 

Thus finally we see that for C3 there are 135 = 126 + 9 inequalities of which 24 
are trivially redundant (9 in 126 + 9 coming from the inequalities defining inside 
a^). There are 9 more redundant inequalities. These 9 inequalities do not occur in 
the system for . Hence the subsystem for C3 can be brought down to altogether 
102 inequalities. Moreover, a computer calculation shows that the polyhedral cone 
D^i^Cs) has exactly 102 faces and thus these 102 inequalities are irredundant. 

4.3. The inequalities for B^. In this subsection we take simply-connected 
G of type B3, i.e., G = Spin (7). 

We note that the Weyl chamber A is given by triples x, y, z of real numbers 
satisfying 

X > y > z > 0. 

The inequalities will now be in terms of (wi , U2 , 1^3 ) G A^ with Vi = {xi,yi, Zi),i = 
1,2,3. 

The Weyl groups for Sp(6) and Spin(7) are isomorphic. In fact, in the standard 
coordinates {x,y,z) they are identical. Hence the sets W^\i = 1,2,3 will be 
identical. However the operators Ay^ and the polynomials Pw will be different (but 
proportional) as we now see. To distinguish, we will denote them by p^^'^' and 
^Spin(7) pggpgQ^jvely. 

We will need the following proposition. 

Proposition 4.9. 



„Spi> 



^ X y [xyz) ^^^^^^ 

Proof. By equation © we have 

Spin(7) ^ xyz[x^ - y^){x^ - z^){y'^ - z"^) 

Hence the proposition follows from the corresponding result for Sp(6). □ 
The next lemma tells us how to read off the polynomials Pw for the case of 
Spin(7) from the corresponding polynomials for Sp(6). We will temporarily use the 
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notation A^"^'"'^^ and A^'"^^ for the Dcmazure-BGG operators A^ for the groups 
Spin(7) and Sp(6) respectively. 

Lemma 4.10. Let v € W and let n{v,t) be the number of times the simple 
reflection t occurs in some reduced decomposition of v. Then we have 

^Spin(7) ^ 2"('''*)^Sp(6)^ 



Proof = 2 AfP^'^ and ^^^'-^'^ = AfP'^^^^^ = A^^^'l 



□ 



Corollary 4.11. For any w £W, p. 



Spin(7) _ 2"'" "0'*' Sp(6) _ n-«(«,,t) Sp(6) 



P 



Pu 



Proof. Note that n{w, t) = 8 — n{v, t), for v — wq- D 
4.3.1. The subsystem associated to H*{G/Pi). We note that Wp-^ is the group 
generated by s and t. We have (since this is what we had for Sp(6)) 

Lemma 4.12. W^' = {e, r, sr, tsr, stsr, rstsr}. 

We have G/Pi = Q5, the smooth quadric hypersurface in CP^ so the inequal- 
ities will be parametrized by a subset of the ordered partitions of 5. We will 
abbreviate the classes ew to Oi according to the following table. In addition, we list 
the elements w of W^^ , their lengths, the maximally singular weight Xw associ- 
ated to the Schubert cycle X^^ = and the notation for the cohomology class 
PZ?(Xa„), the cohomology class that is Poincare dual to Xx^. 



w 








PD{XxJ 


e 





(1,0,0) 


1 


0-5 


r 


1 


(0,1,0) 


fll 


04 


sr 


2 


(0,0,1) 


0-2 


0-3 


tsr 


3 


(0,0,-1) 


0-3 


02 


stsr 


4 


(0,-1,0) 


04 


Ol 


rstsr 


5 


(-1,0,0) 


05 


1 



The following theorem follows easily from Corollary 
spending theorem for Sp(6). 



by using the corre- 



Theorem 4.13. The multiplication table for H* {G / Pi) is given by the following 
table. 



H*[G/Pi) 


Ol 


02 


03 


04 


as 


Ol 


02 


2a3 


04 


05 





02 




2a4 


05 









We now give the corresponding subsystem, leaving to the reader the task of 
symmetrizing the inequalities below. 



Xi < X2+ X3 

yi <y2 + X3 

Zi < Z2+ X3 

zi <y2 + ys 



(5,0,0) 
(4,1,0) 
(3,2,0) 
(3,1,1) 



After symmetrizing there are 18 inequalities, none are trivially redundant. 
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4.3.2. The subsystem associated to H*{G/P2). The space G/P2 is the space 
of totally-isotropic 2-planes. We have that Wp^ is the group generated by the 
commuting simple reflections r and t. We have, as for Sp(6), 

Lemma 4.14. W^^ = {e, s, rs, ts, rts, sts, srts, rsts, tsrts, rstrs, rtsrts, srtsrts}. 

We will abbreviate the classes by bi or b'^ or 6" according to the following 
table. 

The following table follows easily from the corresponding tables for Sp(6) and 
Corollary Em 



w 




£{w) 




Pia (mod /) 




e 


(1,1,0) 





1 


1 


b7 


s 


(1,0,1) 


1 


bi 


x + y 


be 


rs 


(0,1,1) 


2 


b'2 


xy 


b'. 


ts 


(1,0,-1) 


2 


b'^ 


1/2 32 


b'l 


rts 


(0,1,-1) 


3 


b'3 


1/2 xy{x + y) 


b'i 


sts 


(1,-1,0) 


3 


b'i 


1/2 33 


b'l 


srts 


(0,-1,1) 


4 


b'. 


1/2 {xyY 


b'3 


rsts 


(-1,1,0) 


4 


b'l 


1/2 .94 


b'l 


tsrts 


(0,-1,-1) 


5 


b'. 


1/4 xy{x + y){xy + z'^) 


b'2 


rstrs 


(-1,0,1) 


5 


b'l 


1/2 a;2;33 


h" 
"2 


rtsrts 


(-1,0,-1) 


6 


be 


1/4 (xyf 


bi 


srtsrts 


(-1,-1,0) 


7 


b7 


1/4 {xy)'\x + y) 


1 



From these formulae one can easily construct the multiplication table for H* {G/ P2). 
Theorem 4.15. The cohomology ring H*{G/P2) is given by the following table. 



H*{G/P2) 


bi 


b'2 


h" 
"2 


b's 


bl 


bi 


b'2 + 26^' 


263 


^3 + b'l 


2b'^ + b'l 


b'^ + 2b'l 


b'2 




26^ 


b'i + b'l 


2b', + b'l 


bl 


b'l 






b'^ + b'l 


b', + b'l 


b'5 + bl 


b'3 








266 


be 


bl 










2be 



H*{G/P2) 


b'. 


bl 


b'. 


bl 


66 


67 


bl 


n+bi 


bl 


be 


266 


67 





b'2 


266 





bj 











b'l 


66 


66 





67 








b'3 


67 

















bl 





67 















We then read off the inequalities. 
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xi + yi < X2 + y2 + X3 + ys (7,0,0) 

xi + zi < X2 + Z2 + X3 + ys (6, 1, 0) 

yi + Zi<y2+Z2+X3+y3 (5',2',0) 

Xi+Z2<Zi+X2+X3 + y3 (5",2",0) 

yi+Z2<zi+y2 + X3 + y3 (4', 3', 0) 

xi+y2<yi+X2 + x3 + y3 (4",3",0) 

yi+ Zi <X2 + Z2+X3+ Z3 (5', 1,1) 

yi+Z2<Zl+X2+X3+Z3 (4',2",1,) 

xi+z2<yi+X2+X3 + Z3 (4"2", 1) 

(*) yi+Z2<Xi+y2 + X3 + Z3 (3",3',1) 

(*) yi+Z2<Xi+X2+y3 + Z3 (3", 2", 2') 

(*) zi + Z2<yi + x2 + y3 + z3 (3', 2", 2') 

(*) Zi + Z2 + Z3<yi+X2+X3 (3', 2", 2") 

(*) yi+Z2 + Z3<Xi+X2 + X3 (3", 2", 2") 



The inequalities corresponding to the ordered partitions (3",3',1) (3", 2", 2'), 
(3', 2", 2'), (3', 2", 2") and (3", 2", 2") are trivially redundant. After symmetrizing 
they give rise to 24 trivially redundant inequalities. The trivially redundant inequal- 
ities corresponding to the decorated ordered partitions (3', 2", 2") and (3", 2", 2") 
do not occur in the system for Sp(6). 

There are 72 inequalities after symmetrizing, of which 24 are trivially redun- 
dant. 

4.3.3. The subsystem associated to H*{G/P3). The space G/P3 is the space 
of totally-isotropic 3-planes in C^. The group Wp^ is generated by the simple 
reflections r and s. We have the following from the corresponding result for Sp(6). 

Lemma 4.16. 



W^^ = {e, t, st, rst, tst, trst, strst, tstrst}. 

We again abbreviate the classes to bi's or b'^s or 6"'s according to the 
following table. 
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w 


£{w) 








e 





(1,1,1) 


1 


be 


t 


1 


(1,1,-1) 


bi 


b5 


st 


2 


(1,-1,1) 


b2 


bi 


rst 


3 


(-1,1,1) 




b'i 


tst 


3 


(1,-1,-1) 




b'. 


trst 


4 


(-1,1,-1) 


hi 


b2 


strst 


5 


(-1,-1,1) 


65 


bi 


tstrst 


6 


(-1,-1,-1) 


foe 


1 



Theorem 4.17. The cohomology ring is given by the following table. 



H*{G/P:i) 


hi 


h2 


b's 




hi 


^5 


he 


bi 


h2 


h'3 + h':i 


hi 


hi 


h5 


he 





b2 




2bi 


b5 


h5 


he 








b'. 









he 











b'i 





















In this case we find the fohowing subsystem of hnear inequalities. 



xi+yi+ zi < X2 + y2 + Z2 + X3 + ys + Z3 (6, 0, 0) 

xi + yi + Z2 < zi + X2 + y2 + X3 + ys + 23 (5, 1, 0) 

xi + zi + y2 < yi + X2 + Z2 + X3 + + Z3 (4, 2, 0) 

xi + y2 + Z2 < yi + zi + X2 + X3 + ys + Z3 (3', 3", 0) 

(**) xi + zi + Z2 + Z3 < yi + X2 +y2 + X3 + y3 (4,1,1) 

xi + 2/2 + Z3 < yi + zi + X2 + Z2 + X3 + ys (3', 2, 1) 

(**) yi + zi + y2 + Z3 < xi + X2 + Z2 + X3 + ?/3 (3", 2, 1) 



After symmetrizing there are 36 inequalities. None are trivially redundant. 
However the 9 inequalities corresponding to the ordered partitions (4, 1, 1) and 
(3", 2,1) and marked by (**) above do not occur for Sp{6) and consequently they 
must be redundant. 

We now check this directly. 

In order to see that the 3 inequalities corresponding to (4, 1, 1) are redundant, 
we observe (from the first subsystem correspoding to G/Pi) that xi < X2 + X3. 
Furthermore, we have the inequalities for A given by < y^, 1 < z < 3. Hence 
xi + zi + Z2 + Z3 < X2 + X3 + yi + y2 -\- y3. As for the 6 inequalities corresponding to 
(3", 2, 1), we have (from the first subsystem) zi < 22 + 2:3 and the inequalities (for 
A) yi < xi, y2<X2, and Z3 < ^3. Hence Zi + yi + y2 + Z3 < Z2 + X3 + Xi + X2 + y3- 

To summarize, for B3, there are altogether 135 = 126 + 9 inequalities (including 
9 needed to define A'^ in ) of which 24 are trivially redundant and there are 9 more 
redundant inequalities. These 9 inequalities do no occur in the system for Sp(6). 
Hence the subsystem for B3 can be brought down to altogether 102 inequalities. 
Moreover, a computer calculation shows that the polyhedral cone 03(33) has exactly 
102 faces and thus these 102 inequalities are irredundant. (Of course, by Theorem 

03(83) ^ 03(03).) 
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5. Generators of the cone 

In the previous section we have described the irredundant system of Hnear 
inequalities defining the polyhedral cones D^lAs) and Ds{Cs) = Dz{B'i). We now 
give a system of generators for the cone Dz{Cz)- The components of each of the 
51 generators are arranged in the order xi, 0:2, 0:3, yi, 2/2, ya, ^i, 2:2, -23 whereas the 
coordinates of the corresponding generators {vi,V2,vs) G D3{Cs) satisfy 

Vi = {xi,yi,Zi),l <i<3. 

Theorem 5.1. The following 51 vectors are a set of generators of the polyhedral 



= £'3(53) in the 9 dimensional 


space 












(1) 1 1 2 1 1 


(27) 


3 2 1 


1 


2 


1 


10 1 


(2) 112 110 110 


(28) 


1 2 2 


1 


1 


2 


1 


(3) 112 1110 1 


(29) 


1 2 2 


1 


2 


1 


1 


(4) 112 1110 10 


(30) 


2 1 2 


1 


1 


2 


1 


(5) 112 11110 


(31) 


2 1 2 


2 


1 


1 


1 


(6) 12 110 10 


(32) 


2 2 1 


1 


2 


1 


1 


(7) 12 110 110 1 


(33) 


2 2 1 


2 


1 


1 


1 


(8) 12 11110 1 


(34) 


1 1 





1 


1 





(9) 12 11110 10 


(35) 


1 1 


1 





1 





(10) 12 111110 


(36) 


1 1 


1 


1 








(11) 2 110 110 


(37) 


1 1 1 








1 





(12) 2 110 110 11 


(38) 


1 1 1 





1 








(13) 211111001 


f39) 


111 


1 











(14) 2 111110 10 


UO) 


oil 





1 


1 


oil 


(15) 2 1111110 


(41) 


10 1 


1 





1 


10 1 


(16) 1 1 


(42) 


110 


1 


1 





110 


(17) 112 112 110 


(43) 


111 





1 


1 


1 


(18) 12 112 110 1 


(44) 


111 





1 


1 


10 


(19) 12 3 12 110 1 


(45) 


111 


1 





1 


1 


(20) 1 3 2 1 1 2 1 1 


(46) 


111 


1 





1 


10 


(21) 1 1 


(47) 


111 


1 


1 





10 


(22) 2 112 110 11 


(48) 


111 


1 


1 





10 


(23) 2 1 3 2 1 1 1 1 


(49) 


111 


1 


1 


1 


1 


(24) 110000000 


(50) 


111 


1 


1 


1 


10 


(25) 2 3 1 2 1 1 1 1 


(51) 


111 


1 


1 


1 


10 


(26) 3 12 112 110 
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